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(54) Browser for documents with annotations 

(57) The present invoition provides a browser for 
viewing documents in Postscript or a sin^lar type for- 
mat, with added functionality. The system of the present 
invention creates information for additional material, 
such as bookmarks, annotations, and hyperlinks, based 
upon user inputs. The information inckides the position 
and content of the additnnal material, and the refer- 
ences to other additional material. The ink)rmatk}n is 
stored in the comments section of the cbcument file or 
In a corresponding auxiliary file, which accompanies the 
document file. While a document is being view in a 
browser, the information is used for manipulating and 
traversing the document The additbnal material is pre- 
sented on the display of the document and can be 
selected by the user. The user then reviews the added 
material and can use the hyperlinks to move to other 
portions of the document Users can add additional 
material. Upon closing the document all of the informa- 
tion is stored for later retrieval. 
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Description 

ReldoffthQ Invention 

[0001] The present invention relates to a computer- 
t>a8ed system for viewing documents, in particular doc- 
uments in a POstSatpt format. More specifically, it 
relates to a viewer which allows the addition of annota- 
tions to documents and hyperlinking cf annotations 
within these documents. 

Background of the Invention 

[0002] A variety of different formats can be used for 
representing documents in a computer. Different stand- 
ards have developed which are used t>ased upon the 
objectives for use of the document 
[0003] In word-processing systems, documents are 
typically represented in ASCII codes with formatting 
codes. ASCII codes represent each character by a spe- 
cific (figttal value. The formatting codes allow different 
type fonts, character fonts, and positions to be used. 
The word-processing fx^ogram then generates the char- 
acters in the appropriate fonts and positions for display. 
Since eadi character is separately represented, char- 
acters can be easily changed, removed, or added. An 
ASCII-t>a&ed format also allows simple searches for 
characters or groups of characters, and can easily rep- 
resent pages. However, representing documents in an 
ASCII-based format has many drawbacks. For example, 
drawings cannot be easily represented in an ASCII- 
based fbnnat Typically, a word processor uses an 
errt^edded object that references a drawing that is 
stored elsewhere in a different format 
[0004] Graphical t>ased formats address some of the 
deficiencies in an ASCII-based formats, but have addi- 
tk»ial problems. In a typical graphical-based format 
each page of a document is represented by bits for each 
light and dark space on the page. For example, a fax 
machine generates a representation of a document 
which is merely tiie pixels which are the dark spaces on 
the page representing characters. Such a format how- 
ever, does not allow searching or skipping pages. Also, 
most graphical formats do not easily grow or shrink 
since the characters can become distorted. 
[0005] Adobe. Inc. developed a graphical type repre- 
sentation called "PostScript" wNch has become the pre- 
mier accepted page-description language. In Postscr^ 
fbrrrtat a graphical representation of a page is used that 
allows for magnificatton and shrinking. The PostScript 
format includes any material tiiat fits upon a printed 
page, including figures and drawings f^ost documents 
are converted to PostScript format for printing. Most 
documents are converted to PostScript format for print- 
ing. Most on-line documents, such as documents on 
CD-ROMs, the Internet, or tfie World Wide Web, are 
represented in Postscript format However, there are still 
some significant deficiencies with files in PostScript for- 



mat TypicaOy, a document viewer simply cfisplays the 
document page as it vtoM appear if printed. Since 
pages in the file are stored sequentially, the viewer must 
go through each page to amve at a d^red paga For 

5 long documents, tNs can be extremely tedious. Gener- 
ally, jumping around in a document is not feasible. Alsa 
information cannot easily be added to the document for 
future reference or for review by others. 
[0006] When one views a paper document he or she 

10 will often scan through the pages, turn to other sections, 
or make notes on the documents or in the margins. 
These actions are not possble in a typical PostScript- 
type document. In order to move arourxJ in a ^aphical 
type document, a different format referred to as hyper- 

15 text, has been used. The Hypertext format allows |x>si- 
tioning a link to some other element, either another 
object or file, or another place in the file, with a specific 
position on a paga To activate the link, the user selects 
the kientified position. For example, U.S. Patent ^k). 

20 5.367.621 discloses a generalized link from a reference 
point in an on-line book to an aribiti^ary mutti media 
object. However, as disclosed in that patent, the links 
must be created by the autiior of the text when tiie book 
is aeated. Art}itiBry links cannot be added to an existing 

25 document. To do so would require entry of new codes 
representing tiie links. 

Summary of the inventiQn 

30 [0007] The foregoing defk:iencies in existing docu- 
ment systems are overcome tiy the present invention 
which includes a browser or viewer for documents, such 
as Postsaipt documents, with added functbnality. The 
system of the present invention reads and displays 

35 PostScript-type documents. It also allows the addition of 
booknrerks. annotations, and hyperlinks in order to 
nK)re easily move around and add infonnation to a Post- 
script document The information for the boolvnariG. 
annotations, and hyperlinks are created by the browser 

40 of tiie present invention. While tiie document is being 
viewed, the information and links are used for manipu- 
lating and traversing tiie document The information is 
also stored in tiie comments section of the Postscript 
document so tiiat they can t»e retrieved later without 

4S compromising tiie existing functionality and portability of 
tiie document. The present inventk>n can also t>e used 
with any page description format documents which 
include a comments section or auxiliary file, not just 
Postscript documents. 

50 

Brief Description of the Drawings 
[0008] 

55 Fig. 1 is a block diagram illustrating hardware of a 
computer system which coukJ be used in 
implementing tiie browser of tiie present 
invention. 
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Rg. 2 represents the data format tor a PostScript 
document , 

Rg. 3 illustrates a display for the present invention. 

Rg. 4 is a flow diagram for operation of the browser 
according to an emtxxJimOTt of the present 
invention. 

Petailecl PescripBon 

[0009] The present invention relates to a viewer or 
browser that operates on a computer to view cfigitally 
stored documents, particularly documents in PostScript 
formats. Rg. 1 illustrates hardware which could be used 
in in^lementirtg the present invention. As illustrated in 
Fig. 1, computer system 1 includes central processing 
unit (CPU) 10. The CPU 10 can be any type of proces- 
sor, such as those used in general-purpose computers 
for executing instructions. 

[0010] A program memory 21 stores instruction steps 
executed by the CPU 10 in order to read, display and 
modify documents. The documents are stored in the 
document memory 20. The program memory 21 and 
document memory 20 can l>e any type of memories 
including RAM, ROM, CD-ROM, or other digital storage 
medium. Although the program memory 21 and docu- 
ment memory 20 are illustrated as separate elements, 
they may also t>e different portions of the same memory 
structura 

[0011] A display 30 is connected to the CPU 10 in 
order to display the documents and other information to 
the user. A keytx>ard 40 and mouse 41 are connected to 
the CPU 10 for tiie user to display the documents and 
operate the browser. Of course, other devices could be 
used by the user in order to manipulate and display doc- 
uments. 

[001 2] An input device 50 is connected to the CPU 1 0 
in order to input document data into the document mem- 
ory 20. The input device 50 could include a modem for 
connection to an extemal source such as the Internet, 
or other device for retrieving documents in the proper 
format 

[0013] As illustrates in Fig. 2. document data 70 for a 
Postscript document includes two sections, a data sec- 
tion 80 and a comments section 90. The data section 80 
is divided into pages 81 each section representing a 
single page of the document Ordinarily, when the doc- 
ument is displayed or printed, the information for each 
page in the data section is retrieved and processed in 
order to display or print the document The comments 
section 90 is of variable size and allows the addition of 
information unrelated to tiie actual display of the docu- 
ment. In the present invention, annotation and hyperiink 
information is stored in the comment section. Thus, the 
data section 80 is not affected and the document can be 
printed or displayed by any viewer or browser in the 
ordinary manner. Although a PostSaipt format is illus- 



4 

trated. the present invention can opa'ate with different 
formats. The document format nrust include a data sec- 
tion separated into pages and a comment section or 
auxiPary fila The browser operates in the same manner 
in adding annotations and hyperGnks to the document 
regardless of the document tomrmt. 
[0014] Rg. 3 represents a cfisplay 100 of a document 
according to tiie present invention. The document in 
PostScript fomiat can include text 110 and figires or 
drawings 111. The text 110 and the drawings 111 are 
stored in the data section 80 of the document data The 
browser of the present lnventk>n retrieves and displays 
this information for each page. Any known Postscript 
interpreter can be used for this function. The browser 
also allows tiie addition of anrKTtation icons 120 at any 
location on the page. Of course, for other types of docu- 
ment formats, a corresponding, af^ropriate inta-preter 
would be used. The annotation icon 120 includes a title 
122. a representation of additional information or text 
1 21 . and a representation of any hyperlinks 1 23 to other 
annotations. Annotations are reviewed and changed 
tiirough a dialog box 130. The dialog box 130 Includes 
space Ibr tiie name 132 of tiie annotation, a hyperiink 
133 for tiie annotation, and the text 135 of the annota- 
tion. The dialog box 130 also includes buttons for per- 
forming certain functions witii respect to tiiis annotation. 
When the user revises a name, tiyperlink destination, or 
text of tiie annotation, the user can then select the 
update button 136, or cancel button 137 in order to 
change or not change tiie annotaticm. The user may 
also select tiie remove button 138 In order to eliminate 
tiie annotation. The browser display also includes ether 
areas for man^iulating and viewing annotations in tiie 
document At ttie bottom of the saeen. there are but- 
tons for nxTving to the prevbus page 140 and next page 
141. A hypertext button 142 is used for adding annota- 
tions or hyperiinks. The user may select the page menu 
143 in order to move around in tiie document or select 
additional pages. The file menu 144 is used to open and 
dose documents and exit the system. 
[001 5] Rg. 4 illustrates the f tow for a program instan- 
tiating tiie browser and allowing review of documents. 
At step 200, the data for tiie Postscript document Is read 
from the document memory 20. 
[001 6] A step 200, the comments section of the docu- 
ment data is read from tiie document menrK>ry 20 in 
order to determine annotations. The annotations are 
stored following delimiters on tiie comments sectton of 
tiie postscript file. Table 1 illustrates storage of the 
annotation information in tiie comments section. Of 
course, tiie annotation information could t>e stored in 
any fomriat which permits tiie Information for each anno- 
tation to be retrieved. 
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%Browser Annotation 0.0120050 0.072519 
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TABLE 1 (continued) 
%BrowGef AnnotationName marker 
%BrQwserAnnotatk)nTeKt adsf 
%Brow8erAnnotationdEnd ^ 
%BrowserAnnotation 4 0.174938 0.176245 
%BrGw&erAnnotationName label 
%Brotv8erAnnotationlJnk 0 

10 

%Brow86rAnr)otatx)nBacldink 0 
%BrGwserAnnotatk)nT6xt This is an annotation 
with nultiple 

%BrowserAnnotatk)nText lines 
%BrQW8erAnnotatk)nEnd 

[001 7] The program the creates a Hnk structure t>ased 
upon the annotatk>n information (step 210). The first 20 
page is then selected (step 215). and displayed (step 
220). The pages are displayed in the same manner as 
any browser displays a Postscript file. The system the 
waits for an input from the user (step 225). User may 
input information using the keytxiard 40. mouse 41 , or 2s 
other input device. The steps to cause action are simple 
as iQustrated in Rg. 4. At step 230, a user selects the 
prenous page by selecting the previous page button 
140 using the mouse. When the previous page is 
selected, the page number is adjusted (step 235) and 30 
the presnous page is then di^tayed at step 220. Simi- 
larly, when the next page button 141 is selected (step 
240) the page number is adjusted upwards by one (step 
245) and the next page is displayed in step 220. A Go To 
page feature (step 250) can be selected using the page 35 
menu. The user then inputs the page number (step 
255). That page nurTt>er then becomes the current page 
(step 257). which is displayed at step 220. The user can 
view an annotation (step 260) by selecting an annota- 
tion kx)n. When the annotation icon is selected, the 40 
annotation dialog box is displayed (step 265). When the 
user is done viewing the annotation, the user wi!l select 
the cancel button 137 (step 267). A user can go to the 
next linked annotation (step 270) by clicking on the 
annotation portion 123 of the annotation icon 120. As 45 
illustrated in Table 1, the hyperlink information includes 
the number of the linked annotation, which identifies the 
page and location on the page. The current page then 
becomes the target page of the hyperlink and is dis- 
played in step 220. 50 
[0018] Rnally. the user may edit or add annotations 
(steps 280-286). To modify an annotation the user 
wouki select the annotatbn-insertion icon, which will 
cause dialog box 130 to be displayed. The user can 
then edit the name, hyperlink destination, or annotation ss 
text. When the user selects the update button 136 the 
information is stored with the linked data in order to 
maintain the new information. If the user selects the 



cancel button, then any changes are not made to the 
annotatkxi. The user may also select the remove button 
138 which results in the name. hyperGnk data arxi text 
being deleted from the link data 
[001 9] When the user exits the browse or document 
(step 290) the information in the linked data is then 
stored in the comments section of the document data 
stored in the document memory. By storing informatk)n 
in the comments section, the data portion of the docu- 
ment is not affected. The document can still be read, 
displcyed and printed by other programs without the 
annotation information. 

[0020] Having now descrSsed a few emtxxiiments of 
the invention, it should be apparent to those skilled in 
the art that the foregoing is merely illustrative and rxjt 
limiting, having been presented bf way of example only. 
Numerous nxxiifications and other emtxxJiments are 
within tiie scope of one of ordinary skill in the art and 
are contemplated as failing within the scope of the 
invention as d^ined by the apperuded claims. 

Claims 

1. A system for viewing a document having a com- 
ment data area comprising: 

a browser for reading document data and dis- 
playing said document data; 

annotation means for reading additional data in 
said comment data area associated with said 
docunrent data; and 

anrKrtation display means for displaying the 
additional data with con^esponding pages of 
said document data. 

2. The system of claim 1. further comprising annota- 
tion creation means for creating additional data 
associated with said document data. 

3. The system of daim 1 , wherein said additional data 
includes a name, a location in said document data, 
and text. 

4. The system of dalm 1 , wherein said annotation dis- 
play means displays said additional data as an icon 
at a specified location relative to display of said doc- 
ument data; and wherein sakJ system further com- 
prises annotation enlargement means for 
displaying said additional data as text when sakJ 
icon is selected by a user. 

5. The system of daim 1 , wherein said additional data 
indudes a hyperlink to a second location in said 
document data; said system further comprising 
moving means for moving to said second location 
so as to display said document data at sakJ second 
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location. 

6. The system of claim 1 , further comprtstng: 

annotation storage means for storing said addi- 5 
tional data in said comment data area associ- 
ated with said document data. 

7. The system of daim 1 , wherein said document Is in 

a PostScript format and wherein said comnient io 
data area is a comment field of said document 

8. A method for viewing a document comprising the 
steps of: 

IS 

reading documerrt data of said document: 

displaying portions of said document data; 

creating additional data associated with a loca- 20 
tion in said documerrt data based upon a user 
input; and 

storing said additional data in a comment data 
area of said docunr)ent ss 

9. The method of daim 8, further comprising the step 
of reading said additional data In the comment data 
area of said document 

30 

10. The method of daim 9, further comprising the step 
of displaying said additional data at said location 
associated with said document data. 

11. The method of daim 10. wherein said additional 35 
data is displayed as an icon; 

the metiiod further con^ising the step of dis- 
playing said additional data as text when said 
icon is selected by a user. 4o 

1 2. The method of daim 8, wherein said additional data 
includes a second location assodated with said 
document data; 

46 

the metiiod forther comprising tiie step display- 
ing a portion of said document data assodated 
with said second location when said associated 
data is selected by said user. 

50 
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